Pandas Profiling Report

Dataset statistics

Number of variables	14
Number of observations	636262
Missing cells	0
Missing cells (%)	0.0%
Duplicate rows	0
Duplicate rows (%)	0.0%
Total size in memory	55.8 MiB
Average record size in memory	92.0 B

Variable types

Numeric	9
Categorical	5

Warnings

`name_orig` has a high cardinality: 636170 distinct values	High cardinality
`name_dest` has a high cardinality: 457297 distinct values	High cardinality
`step` is highly correlated with `days`	High correlation
`amount` is highly correlated with `dif_balance_dest`	High correlation
`old_balance_org` is highly correlated with `new_balance_orig`	High correlation
`new_balance_orig` is highly correlated with `old_balance_org`	High correlation
`old_balance_dest` is highly correlated with `new_balance_dest`	High correlation
`new_balance_dest` is highly correlated with `old_balance_dest`	High correlation
`days` is highly correlated with `step`	High correlation
`dif_balance_dest` is highly correlated with `amount`	High correlation
`step` is highly correlated with `days`	High correlation
`amount` is highly correlated with `old_balance_dest` and 1 other fields	High correlation
`old_balance_org` is highly correlated with `new_balance_orig`	High correlation
`new_balance_orig` is highly correlated with `old_balance_org` and 1 other fields	High correlation
`old_balance_dest` is highly correlated with `amount` and 1 other fields	High correlation
`new_balance_dest` is highly correlated with `amount` and 1 other fields	High correlation
`days` is highly correlated with `step`	High correlation
`dif_balance_orig` is highly correlated with `dif_balance_dest`	High correlation
`dif_balance_dest` is highly correlated with `new_balance_orig` and 1 other fields	High correlation
`step` is highly correlated with `days`	High correlation
`old_balance_org` is highly correlated with `new_balance_orig`	High correlation
`new_balance_orig` is highly correlated with `old_balance_org` and 1 other fields	High correlation
`old_balance_dest` is highly correlated with `new_balance_dest`	High correlation
`new_balance_dest` is highly correlated with `old_balance_dest`	High correlation
`days` is highly correlated with `step`	High correlation
`dif_balance_dest` is highly correlated with `new_balance_orig`	High correlation
`dif_balance_orig` is highly correlated with `is_fraud`	High correlation
`amount` is highly correlated with `new_balance_dest` and 1 other fields	High correlation
`old_balance_org` is highly correlated with `new_balance_orig`	High correlation
`old_balance_dest` is highly correlated with `new_balance_dest`	High correlation
`is_fraud` is highly correlated with `dif_balance_orig`	High correlation
`new_balance_dest` is highly correlated with `amount` and 2 other fields	High correlation
`days` is highly correlated with `step`	High correlation
`new_balance_orig` is highly correlated with `old_balance_org`	High correlation
`step` is highly correlated with `days`	High correlation
`dif_balance_dest` is highly correlated with `amount` and 1 other fields	High correlation
`amount` is highly skewed (γ1 = 30.74367403)	Skewed
`old_balance_dest` is highly skewed (γ1 = 21.97917021)	Skewed
`new_balance_dest` is highly skewed (γ1 = 21.22636428)	Skewed
`dif_balance_orig` is highly skewed (γ1 = -26.86841927)	Skewed
`dif_balance_dest` is highly skewed (γ1 = 32.5985827)	Skewed
`name_orig` is uniformly distributed	Uniform
`name_dest` is uniformly distributed	Uniform
`old_balance_org` has 210285 (33.1%) zeros	Zeros
`new_balance_orig` has 361277 (56.8%) zeros	Zeros
`old_balance_dest` has 270408 (42.5%) zeros	Zeros
`new_balance_dest` has 243933 (38.3%) zeros	Zeros
`dif_balance_orig` has 208941 (32.8%) zeros	Zeros
`dif_balance_dest` has 231697 (36.4%) zeros	Zeros

Reproduction

Analysis started	2021-08-18 17:03:49.762913
Analysis finished	2021-08-18 17:04:58.163471
Duration	1 minute and 8.4 seconds
Software version	pandas-profiling v3.0.0
Download configuration	config.json

step
Real number (ℝ_≥0)

HIGH CORRELATION
HIGH CORRELATION
HIGH CORRELATION
HIGH CORRELATION

Distinct	629
Distinct (%)	0.1%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%
Mean	243.6019501

Minimum	1
Maximum	743
Zeros	0
Zeros (%)	0.0%
Negative	0
Negative (%)	0.0%
Memory size	1.2 MiB

Quantile statistics

Minimum	1
5-th percentile	16
Q1	156
median	241
Q3	335
95-th percentile	492
Maximum	743
Range	742
Interquartile range (IQR)	179

Descriptive statistics

Standard deviation	142.3980298
Coefficient of variation (CV)	0.5845520928
Kurtosis	0.3160876985
Mean	243.6019501
Median Absolute Deviation (MAD)	90
Skewness	0.3691862978
Sum	154994664
Variance	20277.19888
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
19	5214	0.8%
187	4976	0.8%
18	4968	0.8%
307	4701	0.7%
235	4674	0.7%
163	4627	0.7%
139	4560	0.7%
355	4531	0.7%
403	4482	0.7%
259	4480	0.7%
Other values (619)	589049	92.6%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
1	262	< 0.1%
2	103	< 0.1%
3	52	< 0.1%
4	53	< 0.1%
5	69	< 0.1%
6	176	< 0.1%
7	666	0.1%
8	2156	0.3%
9	3751	0.6%
10	3614	0.6%

Value	Count	Frequency (%)
743	2	< 0.1%
741	2	< 0.1%
740	1	< 0.1%
739	2	< 0.1%
737	2	< 0.1%
736	2	< 0.1%
735	1	< 0.1%
734	2	< 0.1%
733	1	< 0.1%
731	2	< 0.1%

type
Categorical

Distinct	5
Distinct (%)	< 0.1%
Missing	0
Missing (%)	0.0%
Memory size	4.9 MiB

CASH_OUT	223667
PAYMENT	215258
CASH_IN	140099
TRANSFER	53153
DEBIT	4085

Length

Max length	8
Median length	7
Mean length	7.422231722
Min length	5

Characters and Unicode

Total characters	4722484
Distinct characters	18
Distinct categories	2 ?
Distinct scripts	2 ?
Distinct blocks	1 ?

The Unicode Standard assigns character properties to each code point, which can be used to analyse textual variables.

Unique

Unique	0 ?
Unique (%)	0.0%

Sample

1st row	CASH_OUT
2nd row	CASH_OUT
3rd row	TRANSFER
4th row	PAYMENT
5th row	PAYMENT

Common Values

Value	Count	Frequency (%)
CASH_OUT	223667	35.2%
PAYMENT	215258	33.8%
CASH_IN	140099	22.0%
TRANSFER	53153	8.4%
DEBIT	4085	0.6%

Length

Histogram of lengths of the category

Pie chart

Value	Count	Frequency (%)
cash_out	223667	35.2%
payment	215258	33.8%
cash_in	140099	22.0%
transfer	53153	8.4%
debit	4085	0.6%

Most occurring characters

Value	Count	Frequency (%)
A	632177	13.4%
T	496163	10.5%
S	416919	8.8%
N	408510	8.7%
C	363766	7.7%
H	363766	7.7%
_	363766	7.7%
E	272496	5.8%
O	223667	4.7%
U	223667	4.7%
Other values (8)	957587	20.3%

Most occurring categories

Value	Count	Frequency (%)
Uppercase Letter	4358718	92.3%
Connector Punctuation	363766	7.7%

Most frequent character per category

Uppercase Letter

Value	Count	Frequency (%)
A	632177	14.5%
T	496163	11.4%
S	416919	9.6%
N	408510	9.4%
C	363766	8.3%
H	363766	8.3%
E	272496	6.3%
O	223667	5.1%
U	223667	5.1%
P	215258	4.9%
Other values (7)	742329	17.0%

Connector Punctuation

Value	Count	Frequency (%)
_	363766	100.0%

Most occurring scripts

Value	Count	Frequency (%)
Latin	4358718	92.3%
Common	363766	7.7%

Most frequent character per script

Latin

Value	Count	Frequency (%)
A	632177	14.5%
T	496163	11.4%
S	416919	9.6%
N	408510	9.4%
C	363766	8.3%
H	363766	8.3%
E	272496	6.3%
O	223667	5.1%
U	223667	5.1%
P	215258	4.9%
Other values (7)	742329	17.0%

Common

Value	Count	Frequency (%)
_	363766	100.0%

Most occurring blocks

Value	Count	Frequency (%)
ASCII	4722484	100.0%

Most frequent character per block

ASCII

Value	Count	Frequency (%)
A	632177	13.4%
T	496163	10.5%
S	416919	8.8%
N	408510	8.7%
C	363766	7.7%
H	363766	7.7%
_	363766	7.7%
E	272496	5.8%
O	223667	4.7%
U	223667	4.7%
Other values (8)	957587	20.3%

amount
Real number (ℝ_≥0)

HIGH CORRELATION
HIGH CORRELATION
HIGH CORRELATION
SKEWED

Distinct	622517
Distinct (%)	97.8%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%
Mean	180035.7065

Minimum	0
Maximum	69886731.3
Zeros	3
Zeros (%)	< 0.1%
Negative	0
Negative (%)	0.0%
Memory size	4.9 MiB

Quantile statistics

Minimum	0
5-th percentile	2224.931
Q1	13429.5075
median	74896.38
Q3	208974.285
95-th percentile	517876.791
Maximum	69886731.3
Range	69886731.3
Interquartile range (IQR)	195544.7775

Descriptive statistics

Standard deviation	600588.416
Coefficient of variation (CV)	3.335940562
Kurtosis	1757.615666
Mean	180035.7065
Median Absolute Deviation (MAD)	68391.61
Skewness	30.74367403
Sum	1.145498787 × 10¹¹
Variance	3.607064455 × 10¹¹
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
10000000	323	0.1%
15000	10	< 0.1%
5000	7	< 0.1%
100000	5	< 0.1%
10000	5	< 0.1%
8155.63	4	< 0.1%
4374.97	4	< 0.1%
2870.03	4	< 0.1%
10180.18	4	< 0.1%
5320.17	4	< 0.1%
Other values (622507)	635892	99.9%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
0	3	< 0.1%
0.01	1	< 0.1%
0.24	1	< 0.1%
0.41	1	< 0.1%
0.43	1	< 0.1%
0.51	1	< 0.1%
0.55	1	< 0.1%
0.58	1	< 0.1%
0.6	1	< 0.1%
0.68	1	< 0.1%

Value	Count	Frequency (%)
69886731.3	1	< 0.1%
63294839.63	1	< 0.1%
51141938.17	1	< 0.1%
49522819.36	1	< 0.1%
47825067.55	1	< 0.1%
46874551.96	1	< 0.1%
46698160.51	1	< 0.1%
42684988.59	1	< 0.1%
41818052.2	1	< 0.1%
40891132.65	1	< 0.1%

name_orig
Categorical

HIGH CARDINALITY
UNIFORM

Distinct	636170
Distinct (%)	> 99.9%
Missing	0
Missing (%)	0.0%
Memory size	4.9 MiB

C501544405	2
C1125240410	2
C491393722	2
C2121401286	2
C786304962	2
Other values (636165)	636252

Length

Max length	11
Median length	11
Mean length	10.48223216
Min length	5

Characters and Unicode

Total characters	6669446
Distinct characters	11
Distinct categories	2 ?
Distinct scripts	2 ?
Distinct blocks	1 ?

The Unicode Standard assigns character properties to each code point, which can be used to analyse textual variables.

Unique

Unique	636078 ?
Unique (%)	> 99.9%

Sample

1st row	C1389413404
2nd row	C958468196
3rd row	C857481806
4th row	C558963849
5th row	C1644082954

Common Values

Value	Count	Frequency (%)
C501544405	2	< 0.1%
C1125240410	2	< 0.1%
C491393722	2	< 0.1%
C2121401286	2	< 0.1%
C786304962	2	< 0.1%
C696791913	2	< 0.1%
C331659194	2	< 0.1%
C1820871729	2	< 0.1%
C136566605	2	< 0.1%
C469443722	2	< 0.1%
Other values (636160)	636242	> 99.9%

Length

Histogram of lengths of the category

Value	Count	Frequency (%)
c1037425017	2	< 0.1%
c1633525635	2	< 0.1%
c331659194	2	< 0.1%
c1537934179	2	< 0.1%
c204685220	2	< 0.1%
c1302315369	2	< 0.1%
c271483321	2	< 0.1%
c142312811	2	< 0.1%
c740029352	2	< 0.1%
c1087177468	2	< 0.1%
Other values (636160)	636242	> 99.9%

Most occurring characters

Value	Count	Frequency (%)
1	880544	13.2%
C	636262	9.5%
2	613975	9.2%
4	570056	8.5%
3	569459	8.5%
7	567600	8.5%
5	567437	8.5%
8	566583	8.5%
9	566310	8.5%
0	565624	8.5%

Most occurring categories

Value	Count	Frequency (%)
Decimal Number	6033184	90.5%
Uppercase Letter	636262	9.5%

Most frequent character per category

Decimal Number

Value	Count	Frequency (%)
1	880544	14.6%
2	613975	10.2%
4	570056	9.4%
3	569459	9.4%
7	567600	9.4%
5	567437	9.4%
8	566583	9.4%
9	566310	9.4%
0	565624	9.4%
6	565596	9.4%

Uppercase Letter

Value	Count	Frequency (%)
C	636262	100.0%

Most occurring scripts

Value	Count	Frequency (%)
Common	6033184	90.5%
Latin	636262	9.5%

Most frequent character per script

Common

Value	Count	Frequency (%)
1	880544	14.6%
2	613975	10.2%
4	570056	9.4%
3	569459	9.4%
7	567600	9.4%
5	567437	9.4%
8	566583	9.4%
9	566310	9.4%
0	565624	9.4%
6	565596	9.4%

Latin

Value	Count	Frequency (%)
C	636262	100.0%

Most occurring blocks

Value	Count	Frequency (%)
ASCII	6669446	100.0%

Most frequent character per block

ASCII

Value	Count	Frequency (%)
1	880544	13.2%
C	636262	9.5%
2	613975	9.2%
4	570056	8.5%
3	569459	8.5%
7	567600	8.5%
5	567437	8.5%
8	566583	8.5%
9	566310	8.5%
0	565624	8.5%

old_balance_org
Real number (ℝ_≥0)

HIGH CORRELATION
HIGH CORRELATION
HIGH CORRELATION
HIGH CORRELATION
ZEROS

Distinct	258462
Distinct (%)	40.6%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%
Mean	838195.6819

Minimum	0
Maximum	59585040.37
Zeros	210285
Zeros (%)	33.1%
Negative	0
Negative (%)	0.0%
Memory size	4.9 MiB

Quantile statistics

Minimum	0
5-th percentile	0
Q1	0
median	14057.34
Q3	107363.405
95-th percentile	5872246.466
Maximum	59585040.37
Range	59585040.37
Interquartile range (IQR)	107363.405

Descriptive statistics

Standard deviation	2900800.457
Coefficient of variation (CV)	3.460767598
Kurtosis	33.09617991
Mean	838195.6819
Median Absolute Deviation (MAD)	14057.34
Skewness	5.248479964
Sum	5.33312061 × 10¹¹
Variance	8.414643292 × 10¹²
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
0	210285	33.1%
162	120	< 0.1%
109	110	< 0.1%
181	102	< 0.1%
125	100	< 0.1%
161	99	< 0.1%
111	99	< 0.1%
120	98	< 0.1%
106	98	< 0.1%
115	97	< 0.1%
Other values (258452)	425054	66.8%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
0	210285	33.1%
0.44	1	< 0.1%
0.67	1	< 0.1%
1	29	< 0.1%
1.37	1	< 0.1%
2	41	< 0.1%
2.43	1	< 0.1%
3	28	< 0.1%
3.29	1	< 0.1%
4	23	< 0.1%

Value	Count	Frequency (%)
59585040.37	1	< 0.1%
57316255.05	1	< 0.1%
37919816.48	1	< 0.1%
37538004.89	1	< 0.1%
35002864.38	1	< 0.1%
34953893.08	1	< 0.1%
34574029.94	1	< 0.1%
34266226.44	1	< 0.1%
33474678.33	1	< 0.1%
33468608.08	1	< 0.1%

new_balance_orig
Real number (ℝ_≥0)

HIGH CORRELATION
HIGH CORRELATION
HIGH CORRELATION
HIGH CORRELATION
ZEROS

Distinct	274235
Distinct (%)	43.1%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%
Mean	859357.6652

Minimum	0
Maximum	49585040.37
Zeros	361277
Zeros (%)	56.8%
Negative	0
Negative (%)	0.0%
Memory size	4.9 MiB

Quantile statistics

Minimum	0
5-th percentile	0
Q1	0
median	0
Q3	144824.6175
95-th percentile	6030913.765
Maximum	49585040.37
Range	49585040.37
Interquartile range (IQR)	144824.6175

Descriptive statistics

Standard deviation	2935834.207
Coefficient of variation (CV)	3.416312353
Kurtosis	32.03814074
Mean	859357.6652
Median Absolute Deviation (MAD)	0
Skewness	5.171901225
Sum	5.467766268 × 10¹¹
Variance	8.619122494 × 10¹²
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
0	361277	56.8%
72903.91	3	< 0.1%
40563.81	3	< 0.1%
4278.09	3	< 0.1%
5329.29	3	< 0.1%
218648.27	2	< 0.1%
1278.35	2	< 0.1%
131722.05	2	< 0.1%
2674.74	2	< 0.1%
6566.23	2	< 0.1%
Other values (274225)	274963	43.2%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
0	361277	56.8%
0.05	1	< 0.1%
0.5	1	< 0.1%
1.14	1	< 0.1%
1.24	1	< 0.1%
1.45	1	< 0.1%
1.52	1	< 0.1%
1.63	1	< 0.1%
1.87	1	< 0.1%
2.01	1	< 0.1%

Value	Count	Frequency (%)
49585040.37	1	< 0.1%
47316255.05	1	< 0.1%
37950093.25	1	< 0.1%
37919816.48	1	< 0.1%
35017380.83	1	< 0.1%
34499396.72	1	< 0.1%
34348398.13	1	< 0.1%
33623300.06	1	< 0.1%
33576123.85	1	< 0.1%
33512987.05	1	< 0.1%

name_dest
Categorical

HIGH CARDINALITY
UNIFORM

Distinct	457297
Distinct (%)	71.9%
Missing	0
Missing (%)	0.0%
Memory size	4.9 MiB

C248609774	16
C1590550415	15
C2011561834	15
C2083562754	14
C1163480574	13
Other values (457292)	636189

Length

Max length	11
Median length	11
Mean length	10.48172294
Min length	4

Characters and Unicode

Total characters	6669122
Distinct characters	12
Distinct categories	2 ?
Distinct scripts	2 ?
Distinct blocks	1 ?

The Unicode Standard assigns character properties to each code point, which can be used to analyse textual variables.

Unique

Unique	358591 ?
Unique (%)	56.4%

Sample

1st row	C819390946
2nd row	C257205272
3rd row	C134214261
4th row	M635090135
5th row	M332145827

Common Values

Value	Count	Frequency (%)
C248609774	16	< 0.1%
C1590550415	15	< 0.1%
C2011561834	15	< 0.1%
C2083562754	14	< 0.1%
C1163480574	13	< 0.1%
C1954751748	13	< 0.1%
C381132810	13	< 0.1%
C1722902384	13	< 0.1%
C1787868648	13	< 0.1%
C929266212	13	< 0.1%
Other values (457287)	636124	> 99.9%

Length

Histogram of lengths of the category

Value	Count	Frequency (%)
c248609774	16	< 0.1%
c2011561834	15	< 0.1%
c1590550415	15	< 0.1%
c2083562754	14	< 0.1%
c1787868648	13	< 0.1%
c381132810	13	< 0.1%
c1163480574	13	< 0.1%
c1722902384	13	< 0.1%
c1880332929	13	< 0.1%
c929266212	13	< 0.1%
Other values (457287)	636124	> 99.9%

Most occurring characters

Value	Count	Frequency (%)
1	879498	13.2%
2	611481	9.2%
3	570904	8.6%
4	568937	8.5%
0	567669	8.5%
6	567152	8.5%
8	566952	8.5%
9	566926	8.5%
5	566692	8.5%
7	566649	8.5%
Other values (2)	636262	9.5%

Most occurring categories

Value	Count	Frequency (%)
Decimal Number	6032860	90.5%
Uppercase Letter	636262	9.5%

Most frequent character per category

Decimal Number

Value	Count	Frequency (%)
1	879498	14.6%
2	611481	10.1%
3	570904	9.5%
4	568937	9.4%
0	567669	9.4%
6	567152	9.4%
8	566952	9.4%
9	566926	9.4%
5	566692	9.4%
7	566649	9.4%

Uppercase Letter

Value	Count	Frequency (%)
C	421004	66.2%
M	215258	33.8%

Most occurring scripts

Value	Count	Frequency (%)
Common	6032860	90.5%
Latin	636262	9.5%

Most frequent character per script

Common

Value	Count	Frequency (%)
1	879498	14.6%
2	611481	10.1%
3	570904	9.5%
4	568937	9.4%
0	567669	9.4%
6	567152	9.4%
8	566952	9.4%
9	566926	9.4%
5	566692	9.4%
7	566649	9.4%

Latin

Value	Count	Frequency (%)
C	421004	66.2%
M	215258	33.8%

Most occurring blocks

Value	Count	Frequency (%)
ASCII	6669122	100.0%

Most frequent character per block

ASCII

Value	Count	Frequency (%)
1	879498	13.2%
2	611481	9.2%
3	570904	8.6%
4	568937	8.5%
0	567669	8.5%
6	567152	8.5%
8	566952	8.5%
9	566926	8.5%
5	566692	8.5%
7	566649	8.5%
Other values (2)	636262	9.5%

old_balance_dest
Real number (ℝ_≥0)

HIGH CORRELATION
HIGH CORRELATION
HIGH CORRELATION
HIGH CORRELATION
SKEWED
ZEROS

Distinct	365217
Distinct (%)	57.4%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%
Mean	1106841.08

Minimum	0
Maximum	355381433.6
Zeros	270408
Zeros (%)	42.5%
Negative	0
Negative (%)	0.0%
Memory size	4.9 MiB

Quantile statistics

Minimum	0
5-th percentile	0
Q1	0
median	132774.34
Q3	947431.27
95-th percentile	5150751.782
Maximum	355381433.6
Range	355381433.6
Interquartile range (IQR)	947431.27

Descriptive statistics

Standard deviation	3486732.494
Coefficient of variation (CV)	3.15016542
Kurtosis	1164.213696
Mean	1106841.08
Median Absolute Deviation (MAD)	132774.34
Skewness	21.97917021
Sum	7.042409189 × 10¹¹
Variance	1.215730349 × 10¹³
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
0	270408	42.5%
10000000	62	< 0.1%
20000000	24	< 0.1%
40000000	8	< 0.1%
30000000	6	< 0.1%
174	5	< 0.1%
184	4	< 0.1%
6001	4	< 0.1%
347	4	< 0.1%
130	4	< 0.1%
Other values (365207)	365733	57.5%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
0	270408	42.5%
0.79	1	< 0.1%
1.64	1	< 0.1%
2.5	1	< 0.1%
4	2	< 0.1%
4.52	1	< 0.1%
5	1	< 0.1%
9	1	< 0.1%
12.1	1	< 0.1%
12.95	1	< 0.1%

Value	Count	Frequency (%)
355381433.6	1	< 0.1%
355185537.1	1	< 0.1%
311404901.4	1	< 0.1%
301140972.5	1	< 0.1%
286606840.4	1	< 0.1%
257660877.1	1	< 0.1%
235879668.4	1	< 0.1%
235855760.3	1	< 0.1%
219050020.8	1	< 0.1%
210599258.7	1	< 0.1%

new_balance_dest
Real number (ℝ_≥0)

HIGH CORRELATION
HIGH CORRELATION
HIGH CORRELATION
HIGH CORRELATION
SKEWED
ZEROS

Distinct	387378
Distinct (%)	60.9%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%
Mean	1230661.224

Minimum	0
Maximum	355380483.5
Zeros	243933
Zeros (%)	38.3%
Negative	0
Negative (%)	0.0%
Memory size	4.9 MiB

Quantile statistics

Minimum	0
5-th percentile	0
Q1	0
median	215337.58
Q3	1114869.022
95-th percentile	5535900.888
Maximum	355380483.5
Range	355380483.5
Interquartile range (IQR)	1114869.022

Descriptive statistics

Standard deviation	3754355.69
Coefficient of variation (CV)	3.050681711
Kurtosis	1048.216962
Mean	1230661.224
Median Absolute Deviation (MAD)	215337.58
Skewness	21.22636428
Sum	7.830229719 × 10¹¹
Variance	1.409518665 × 10¹³
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
0	243933	38.3%
10000000	8	< 0.1%
18123750.85	6	< 0.1%
4310701.91	6	< 0.1%
19169204.93	5	< 0.1%
971418.91	5	< 0.1%
1983599.05	5	< 0.1%
2364068.61	4	< 0.1%
2107778.11	4	< 0.1%
1092234.24	4	< 0.1%
Other values (387368)	392282	61.7%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
0	243933	38.3%
2.76	1	< 0.1%
3.05	1	< 0.1%
8.89	1	< 0.1%
10.58	1	< 0.1%
12.82	1	< 0.1%
15.32	1	< 0.1%
22.47	1	< 0.1%
23	1	< 0.1%
23.84	1	< 0.1%

Value	Count	Frequency (%)
355380483.5	1	< 0.1%
355185537.1	1	< 0.1%
311492902.8	1	< 0.1%
311404901.4	1	< 0.1%
301248443.8	1	< 0.1%
300985927.9	1	< 0.1%
258034674.3	1	< 0.1%
249370946.2	1	< 0.1%
235932693.8	1	< 0.1%
221425442.2	1	< 0.1%

is_flagged_fraud
Categorical

Distinct	2
Distinct (%)	< 0.1%
Missing	0
Missing (%)	0.0%
Memory size	4.9 MiB

0	636258
1	4

Length

Max length	1
Median length	1
Mean length	1
Min length	1

Characters and Unicode

Total characters	636262
Distinct characters	2
Distinct categories	1 ?
Distinct scripts	1 ?
Distinct blocks	1 ?

The Unicode Standard assigns character properties to each code point, which can be used to analyse textual variables.

Unique

Unique	0 ?
Unique (%)	0.0%

Sample

1st row	0
2nd row	0
3rd row	0
4th row	0
5th row	0

Common Values

Value	Count	Frequency (%)
0	636258	> 99.9%
1	4	< 0.1%

Length

Histogram of lengths of the category

Pie chart

Value	Count	Frequency (%)
0	636258	> 99.9%
1	4	< 0.1%

Most occurring characters

Value	Count	Frequency (%)
0	636258	> 99.9%
1	4	< 0.1%

Most occurring categories

Value	Count	Frequency (%)
Decimal Number	636262	100.0%

Most frequent character per category

Decimal Number

Value	Count	Frequency (%)
0	636258	> 99.9%
1	4	< 0.1%

Most occurring scripts

Value	Count	Frequency (%)
Common	636262	100.0%

Most frequent character per script

Common

Value	Count	Frequency (%)
0	636258	> 99.9%
1	4	< 0.1%

Most occurring blocks

Value	Count	Frequency (%)
ASCII	636262	100.0%

Most frequent character per block

ASCII

Value	Count	Frequency (%)
0	636258	> 99.9%
1	4	< 0.1%

is_fraud
Categorical

HIGH CORRELATION

Distinct	2
Distinct (%)	< 0.1%
Missing	0
Missing (%)	0.0%
Memory size	4.9 MiB

0	635441
1	821

Length

Max length	1
Median length	1
Mean length	1
Min length	1

Characters and Unicode

Total characters	636262
Distinct characters	2
Distinct categories	1 ?
Distinct scripts	1 ?
Distinct blocks	1 ?

The Unicode Standard assigns character properties to each code point, which can be used to analyse textual variables.

Unique

Unique	0 ?
Unique (%)	0.0%

Sample

1st row	0
2nd row	0
3rd row	0
4th row	0
5th row	0

Common Values

Value	Count	Frequency (%)
0	635441	99.9%
1	821	0.1%

Length

Histogram of lengths of the category

Pie chart

Value	Count	Frequency (%)
0	635441	99.9%
1	821	0.1%

Most occurring characters

Value	Count	Frequency (%)
0	635441	99.9%
1	821	0.1%

Most occurring categories

Value	Count	Frequency (%)
Decimal Number	636262	100.0%

Most frequent character per category

Decimal Number

Value	Count	Frequency (%)
0	635441	99.9%
1	821	0.1%

Most occurring scripts

Value	Count	Frequency (%)
Common	636262	100.0%

Most frequent character per script

Common

Value	Count	Frequency (%)
0	635441	99.9%
1	821	0.1%

Most occurring blocks

Value	Count	Frequency (%)
ASCII	636262	100.0%

Most frequent character per block

ASCII

Value	Count	Frequency (%)
0	635441	99.9%
1	821	0.1%

days
Real number (ℝ_≥0)

HIGH CORRELATION
HIGH CORRELATION
HIGH CORRELATION
HIGH CORRELATION

Distinct	606
Distinct (%)	0.1%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%
Mean	10.18464491

Minimum	1
Maximum	30.95833333
Zeros	0
Zeros (%)	0.0%
Negative	0
Negative (%)	0.0%
Memory size	4.9 MiB

Quantile statistics

Minimum	1
5-th percentile	1
Q1	6.5
median	10.04166667
Q3	13.95833333
95-th percentile	20.5
Maximum	30.95833333
Range	29.95833333
Interquartile range (IQR)	7.458333333

Descriptive statistics

Standard deviation	5.878241745
Coefficient of variation (CV)	0.577167078
Kurtosis	0.3364776649
Mean	10.18464491
Median Absolute Deviation (MAD)	3.75
Skewness	0.4069573473
Sum	6480102.542
Variance	34.55372601
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
1	57562	9.0%
7.791666667	4976	0.8%
12.79166667	4701	0.7%
9.791666667	4674	0.7%
6.791666667	4627	0.7%
5.791666667	4560	0.7%
14.79166667	4531	0.7%
16.79166667	4482	0.7%
10.79166667	4480	0.7%
1.791666667	4466	0.7%
Other values (596)	537203	84.4%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
1	57562	9.0%
1.041666667	154	< 0.1%
1.083333333	43	< 0.1%
1.125	4	< 0.1%
1.291666667	1	< 0.1%
1.333333333	3	< 0.1%
1.375	2330	0.4%
1.416666667	3149	0.5%
1.458333333	2902	0.5%
1.5	3956	0.6%

Value	Count	Frequency (%)
30.95833333	2	< 0.1%
30.875	2	< 0.1%
30.83333333	1	< 0.1%
30.79166667	2	< 0.1%
30.70833333	2	< 0.1%
30.66666667	2	< 0.1%
30.625	1	< 0.1%
30.58333333	2	< 0.1%
30.54166667	1	< 0.1%
30.45833333	2	< 0.1%

dif_balance_orig
Real number (ℝ)

HIGH CORRELATION
HIGH CORRELATION
SKEWED
ZEROS

Distinct	342931
Distinct (%)	53.9%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%
Mean	21161.98328

Minimum	-10000000
Maximum	1915267.9
Zeros	208941
Zeros (%)	32.8%
Negative	287230
Negative (%)	45.1%
Memory size	4.9 MiB

Quantile statistics

Minimum	-10000000
5-th percentile	-74279.9
Q1	-10134
median	0
Q3	0
95-th percentile	252672.475
Maximum	1915267.9
Range	11915267.9
Interquartile range (IQR)	10134

Descriptive statistics

Standard deviation	154473.8823
Coefficient of variation (CV)	7.299593815
Kurtosis	1586.505489
Mean	21161.98328
Median Absolute Deviation (MAD)	7270.275
Skewness	-26.86841927
Sum	1.34645658 × 10¹⁰
Variance	2.38621803 × 10¹⁰
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
0	208941	32.8%
-162	91	< 0.1%
-109	91	< 0.1%
-111	86	< 0.1%
-181	85	< 0.1%
-125	85	< 0.1%
-127	84	< 0.1%
-115	84	< 0.1%
-120	82	< 0.1%
-170	82	< 0.1%
Other values (342921)	426551	67.0%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
-10000000	40	< 0.1%
-10000000	2	< 0.1%
-9772559.35	1	< 0.1%
-9468064.05	1	< 0.1%
-9097679.75	1	< 0.1%
-8994286.69	1	< 0.1%
-8991625.83	1	< 0.1%
-8980853.88	1	< 0.1%
-8950011.46	1	< 0.1%
-8924971.59	1	< 0.1%

Value	Count	Frequency (%)
1915267.9	1	< 0.1%
1782621.49	1	< 0.1%
1394689.81	1	< 0.1%
1290876.4	1	< 0.1%
1240885.3	1	< 0.1%
1225177.33	1	< 0.1%
1208150.77	1	< 0.1%
1172012.84	1	< 0.1%
1162958.23	1	< 0.1%
1129849.78	1	< 0.1%

dif_balance_dest
Real number (ℝ)

HIGH CORRELATION
HIGH CORRELATION
HIGH CORRELATION
HIGH CORRELATION
SKEWED
ZEROS

Distinct	404171
Distinct (%)	63.5%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%
Mean	123820.1448

Minimum	-5353303.67
Maximum	82704592.26
Zeros	231697
Zeros (%)	36.4%
Negative	124229
Negative (%)	19.5%
Memory size	4.9 MiB

Quantile statistics

Minimum	-5353303.67
5-th percentile	-222073.1895
Q1	0
median	0
Q3	148805.4575
95-th percentile	559753.337
Maximum	82704592.26
Range	88057895.93
Interquartile range (IQR)	148805.4575

Descriptive statistics

Standard deviation	796750.2258
Coefficient of variation (CV)	6.434738282
Kurtosis	1749.045948
Mean	123820.1448
Median Absolute Deviation (MAD)	62685.34
Skewness	32.5985827
Sum	7.878205297 × 10¹⁰
Variance	6.348109223 × 10¹¹
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
0	231697	36.4%
10000000	19	< 0.1%
-15000	9	< 0.1%
-5000	6	< 0.1%
-182	4	< 0.1%
-100000	4	< 0.1%
-347	3	< 0.1%
-10000	3	< 0.1%
-500	3	< 0.1%
-314	3	< 0.1%
Other values (404161)	404511	63.6%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
-5353303.67	1	< 0.1%
-4525018.81	1	< 0.1%
-4381869.85	1	< 0.1%
-4304267	1	< 0.1%
-2199286.39	1	< 0.1%
-2116822.38	1	< 0.1%
-2014707.88	1	< 0.1%
-1984174	1	< 0.1%
-1952454.02	1	< 0.1%
-1915267.9	1	< 0.1%

Value	Count	Frequency (%)
82704592.26	1	< 0.1%
75885725.63	1	< 0.1%
75549141.11	1	< 0.1%
69886731.3	1	< 0.1%
66308418.91	1	< 0.1%
64950673.26	1	< 0.1%
63294839.63	1	< 0.1%
56829381.3	1	< 0.1%
52403631.67	1	< 0.1%
51343097.27	1	< 0.1%

Pearson's r

The Pearson's correlation coefficient (r) is a measure of linear correlation between two variables. It's value lies between -1 and +1, -1 indicating total negative linear correlation, 0 indicating no linear correlation and 1 indicating total positive linear correlation. Furthermore, r is invariant under separate changes in location and scale of the two variables, implying that for a linear function the angle to the x-axis does not affect r.

To calculate r for two variables X and Y, one divides the covariance of X and Y by the product of their standard deviations.

Spearman's ρ

The Spearman's rank correlation coefficient (ρ) is a measure of monotonic correlation between two variables, and is therefore better in catching nonlinear monotonic correlations than Pearson's r. It's value lies between -1 and +1, -1 indicating total negative monotonic correlation, 0 indicating no monotonic correlation and 1 indicating total positive monotonic correlation.

To calculate ρ for two variables X and Y, one divides the covariance of the rank variables of X and Y by the product of their standard deviations.

Kendall's τ

Similarly to Spearman's rank correlation coefficient, the Kendall rank correlation coefficient (τ) measures ordinal association between two variables. It's value lies between -1 and +1, -1 indicating total negative correlation, 0 indicating no correlation and 1 indicating total positive correlation.

To calculate τ for two variables X and Y, one determines the number of concordant and discordant pairs of observations. τ is given by the number of concordant pairs minus the discordant pairs divided by the total number of pairs.

Phik (φk)

Phik (φk) is a new and practical correlation coefficient that works consistently between categorical, ordinal and interval variables, captures non-linear dependency and reverts to the Pearson correlation coefficient in case of a bivariate normal input distribution. There is extensive documentation available here.

Cramér's V (φc)

Cramér's V is an association measure for nominal random variables. The coefficient ranges from 0 to 1, with 0 indicating independence and 1 indicating perfect association. The empirical estimators used for Cramér's V have been proved to be biased, even for large samples. We use a bias-corrected measure that has been proposed by Bergsma in 2013 that can be found here.

Count
Matrix

A simple visualization of nullity by column.

Nullity matrix is a data-dense display which lets you quickly visually pick out patterns in data completion.

First rows

	step	type	amount	name_orig	old_balance_org	new_balance_orig	name_dest	old_balance_dest	new_balance_dest	days	dif_balance_orig	dif_balance_dest
0	353	CASH_OUT	150540.160	C1389413404	9912.000	0.000	C819390946	29817.590	180357.750	14.708	-9912.000	150540.160
1	282	CASH_OUT	66723.640	C958468196	0.000	0.000	C257205272	1136277.810	1203001.450	11.750	0.000	66723.640
2	228	TRANSFER	1039375.010	C857481806	2328.000	0.000	C134214261	437583.330	1476958.340	9.500	-2328.000	1039375.010
3	36	PAYMENT	9178.610	C558963849	96237.620	87059.010	M635090135	0.000	0.000	1.500	-9178.610	0.000
4	48	PAYMENT	4527.240	C1644082954	51925.000	47397.760	M332145827	0.000	0.000	2.000	-4527.240	0.000
5	22	CASH_OUT	35951.010	C1596965065	29533.000	0.000	C1727565779	12239732.300	12275683.310	1.000	-29533.000	35951.010
6	330	PAYMENT	6738.520	C859233135	0.000	0.000	M1068538554	0.000	0.000	13.750	0.000	0.000
7	228	PAYMENT	21206.810	C1531572949	51453.000	30246.190	M1142464058	0.000	0.000	9.500	-21206.810	0.000
8	207	CASH_OUT	296500.400	C2107606313	0.000	0.000	C32332084	4622375.480	4918875.880	8.625	0.000	296500.400
9	135	CASH_OUT	218014.960	C2070855983	10510.000	0.000	C751256487	657169.850	875184.810	5.625	-10510.000	218014.960

Last rows

	step	type	amount	name_orig	old_balance_org	new_balance_orig	name_dest	old_balance_dest	new_balance_dest	days	dif_balance_orig	dif_balance_dest
636252	321	PAYMENT	871.120	C155502700	29290.000	28418.880	M693853065	0.000	0.000	13.375	-871.120	0.000
636253	394	CASH_IN	220041.020	C131070433	761793.000	981834.020	C466352325	433656.620	213615.610	16.417	220041.020	-220041.010
636254	353	CASH_IN	6286.100	C280350536	7226.000	13512.100	C81030497	0.000	0.000	14.708	6286.100	0.000
636255	372	PAYMENT	707.460	C82052290	150882.410	150174.950	M1038425751	0.000	0.000	15.500	-707.460	0.000
636256	189	CASH_IN	374394.760	C313176195	2975644.790	3350039.550	C1821502927	6544869.360	6170474.600	7.875	374394.760	-374394.760
636257	691	CASH_OUT	184745.770	C1193750587	1155.000	0.000	C1165106583	186549.970	371295.740	28.792	-1155.000	184745.770
636258	21	CASH_OUT	78836.940	C129383044	30658.000	0.000	C1638313098	4642989.020	4721825.960	1.000	-30658.000	78836.940
636259	16	CASH_IN	265300.000	C1294861820	11400.000	276700.000	C2004070631	0.000	488175.010	1.000	265300.000	488175.010
636260	204	PAYMENT	6747.460	C1103134800	6467.720	0.000	M1070124017	0.000	0.000	8.500	-6467.720	0.000
636261	154	PAYMENT	6865.630	C1013856770	0.000	0.000	M1721419416	0.000	0.000	6.417	0.000	0.000

Overview

Variables

Common Values

Length

Pie chart

Most occurring characters

Most occurring categories

Most frequent character per category

Uppercase Letter

Connector Punctuation

Most occurring scripts

Most frequent character per script

Latin

Common

Most occurring blocks

Most frequent character per block

ASCII

Common Values

Length

Most occurring characters

Most occurring categories

Most frequent character per category

Decimal Number

Uppercase Letter

Most occurring scripts

Most frequent character per script

Common

Latin

Most occurring blocks

Most frequent character per block

ASCII

Common Values

Length

Most occurring characters

Most occurring categories

Most frequent character per category

Decimal Number

Uppercase Letter

Most occurring scripts

Most frequent character per script

Common

Latin

Most occurring blocks

Most frequent character per block

ASCII

Common Values

Length

Pie chart

Most occurring characters

Most occurring categories

Most frequent character per category

Decimal Number

Most occurring scripts

Most frequent character per script

Common

Most occurring blocks

Most frequent character per block

ASCII

Common Values

Length

Pie chart

Most occurring characters

Most occurring categories

Most frequent character per category

Decimal Number

Most occurring scripts

Most frequent character per script

Common

Most occurring blocks

Most frequent character per block

ASCII

Interactions

Correlations

Pearson's r

Spearman's ρ

Kendall's τ

Phik (φk)

Cramér's V (φc)

Missing values

Sample